Simulation software 

Cross Reference to Related Applications 

This application claims the benefit of U.S. Provisional Application No. 
60/337,949, filed Dec. 7, 2001, which is hereby incorporated herein by 
reference in its entirety. 

Background of Invention 

[0001] The invention relates to a simulation software and more 
particularly to a simulation software which displays human beings on monitors, 
LCDs, screens, and other display means in a realistic fashion. 

[0002] Lately, simulation software is being used in video games, military 
training devices, and other types of devices which implement virtual reality. 
These devices are designed to display various types of objects which exist in 
the real world, however, the users thereof perceive a sense of awkwardness 
to the movement of a human being displayed thereon since these devices do 
not reflect the movement of a human being in the real world in a precise 
manner. One reason for such awkwardness is that the clothes worn by a 
human being do not wrinkle at all when he/she bends his/her limbs. Fig. 1a 
and Fig. 1b illustrate the method of displaying an arm of a human being by 
utilizing the prior art. As described in Fig. 1 a, arm AR of a human being is 
composed of hand HD, lower arm LA, joint JT, and upper arm UA. Assuming 
that arm UA is covered by fabric FB, i.e., the human being is wearing the 
clothes which cover his/her arms. When arm AR is stretched as described in 
Fig. 1a and joint JT is not bent, wrinkle does not occur on or near joint JT. 
When arm AR is bent as described in Fig. 1b, due to the nature of fabric FB 
one or more wrinkles occur on or near joint JT in the real world. The prior art 
does not describe the movement of limbs in such a way and because no 
wrinkles are shown, the users perceive a sense of awkwardness. 

[0003] U.S. Pat. No. 6,317,125 introduces a video object generation 
method (100) for converting a model (102) such that a tessellation operation 
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(164) can create a realistic character in real time during game play. According 
to this prior art, a shelling and slicing operation (106) produces data strings 
(140) describing a plurality of slices (110) of the model (102). An assign body 
parts and edit strings operation (130) places cuts (134) on the model (102) 
and an apply influences operation (144) establishes the influence on each of a 
plurality of points (142) from a plurality of bones (148) of a skeleton (146). In 
real time operations (162) a tessellation operation (164) creates a triangle 
mesh (165) appropriate to the position and importance of the character in 
game space, and a properly bent character is displayed in a display operation 
(168). This prior art introduces the concept of producing realistic images, 
however, does not explain nor imply the present invention, i.e., the method of 
producing and displaying wrinkles on limbs of a human being. 

[0004] U.S. Pat. No. 6,317,130 introduces apparatus and method to 
enable an animation character object, which is pictorially deformed by 
computer graphics techniques to display a human body or animal or the like in 
the form of a caricature or model, to offer precise and more natural motions at 
its selected constituent portions that have inherently no joints and no bones by 
giving thereto joints and skeletons. According to this prior art, apparatus and 
method for generating skeleton-based animation images in accordance with 
the principles of the invention include solving means as follows. A face section 
of a cubic character object is provided with auxiliary skeletons as vertically 
coupled together. Skeletons are provided which extend from respective 
endpoints of such auxiliary skeletons and are coupled defining an umbrella 
shape as a whole. These skeletons are associated with models each 
consisting of an ensemble of polygons for rendering the character deformable 
by changing rotation amount of each skeleton. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0005] U.S. Pat. No. 6,310,619 introduces a three-dimensional, virtual 
reality, tissue specific model of a human or animal body which provides a high 
level of user-interactivity. According to this prior art, the model functions can 
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be analyzed and user-modified on a tissue-by-tissue basis, thereby allowing 
modeling of a wide variety of normal and abnormal tissue attributes and 
corresponding study thereof. The model can be user-modified through a 
keyboard, or other VR tools such as a haptic interface. The haptic interface 
can modify the model to correspond to the tissue attributes of a user, and can 
provide sensory output corresponding to the interaction of the model to a 
prescripted scene. A three-dimensional, virtual reality, tissue specific model of 
a human or animal body which provides a high level of user-interactivity. The 
model functions can be analyzed and user-modified on a tissue-by-tissue 
basis, thereby allowing modeling of a wide variety of normal and abnormal 
tissue attributes and corresponding study thereof. The model can be user- 
modified through a keyboard, or other VR tools such as a haptic interface. The 
haptic interface can modify the model to correspond to the tissue attributes of 
a user, and can provide sensory output corresponding to the interaction of the 
model to a prescripted scene. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0006] U.S. Pat. No. 5,625,577 introduces a motion analyzing method 
which analyzes and displays motions of a human being or an animal using a 
computer in an interactive manner without requiring trial and error or without 
depending on intuition of an analyst. According to this prior art, a human body 
or an animal body is divided into a plurality of segments connected by joints, 
each of the segments acting as a minimal unit of motion. Data for modeling 
the human or animal body on the basis of physical constraints and the 
inherent nature of each of the segments is maintained in a database. Motions 
are input to be analyzed and the input motions are analyzed using inverse 
dynamics. The resultant movements and the center of gravity of each of the 
segments, the force and torque exerted on each of the joints, the movement 
and the center of gravity of the whole body, and the forces and torques 
exerted on the centers of gravity are superimposed on the human or animal 
body model of the database and are displayed on a screen. The new motions 
thus displayed can be used for the teaching of new skills in the industrial or 
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performing arts, in sports, or in animal training. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0007] U.S. Pat. No. 6,215,500 introduces methods and systems for 
compressing and decompressing 3-D geometry data which includes regularly 
tiled surface portions. According to this prior art, one compression method 
includes representing a surface portion as a "vertex raster", which comprises 
specifying an extent value and encoding the vertex parameter values of 
vertices within the surface portion. The extent of the surface portion specifies 
the arrangement of vertices within the surface portion, and allows the vertices 
to be properly assembled into drawing primitives during decompression. The 
encoded vertex parameter values may be encoded globally (by setting initial 
values and corresponding delta values), locally (on a per-vertex basis), or 
using a combination of these techniques. Absolute, delta encoding, or delta- 
delta encoding may be utilized for these parameter values. Vertex parameters 
which may be encoded in this manner include position, color, normals, z- 
displacement values, texture map coordinates, and surface material 
properties. Additionally, connectivity information may also be encoded using 
this compression method by specifying quad split bits and half-resolution 
edges. Quad split bits are used to tessellate a quadrilateral formed by 
neighboring vertices of a surface portion according to the direction of the 
strongest color change. Half-resolution edges are utilized to gradually shift 
from an area of high resolution to an adjacent surface portion represented in 
lower resolution. For graphical objects which include a plurality of adjacent 
surface portions, a step command is disclosed which allows data from one 
surface portion to be advantageously reused. Decompression of a vertex 
raster representation may comprise decoding the extent value, global 
parameter values, and a per-vertex stream of local parameter values. This 
prior art introduces the concept of producing realistic images, however, does 
not explain nor imply the present invention, i.e., the method of producing and 
displaying wrinkles on limbs of a human being. 
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[0008] U.S. Pat. No. 6,204,860 introduces a system that defines a wire 
curve deformation primitive with a free-form parametric curve associated with 
the closest points to the curve on a surface of a model. According to this prior 
art, the wire curve includes a radius influence defining the points on the object 
which will be deformed. A scale factor determines the amplitude of the scaling 
or point movement that is caused by the wire curve. A blending function of the 
wire curve defines the transition from the deformed regions to the 
undeformed regions of the object. The wire curve can have associated with it 
holder curves defining the domain of deformation about an object caused by 
one or more wires. A holder curve holds the points of the object in place. 
Locators are used to define different parameters values along the wire curve. 
Changes in parameter values around the locators are accomplished by 
interpolation. Deforming includes preprocessing steps as well as deformation 
stage operations. This prior art introduces the concept of producing realistic 
images, however, does not explain nor imply the present invention, i.e., the 
method of producing and displaying wrinkles on limbs of a human being. 

[0009] U.S. Pat. No. 6,144,385 introduces a character animation system 
executing on a computer. According to this prior art, the system provides a 
simple, efficient and powerful user interface that allows the user to specify 
complex animations of multi-legged characters by placing footprints on a 
surface. A compiler automatically generates a natural looking animation based 
on the footprints. Motions such as walking, running, jumping, etc. are easily 
animated depending on the way footprints are placed. The user is able to 
create new footprint patterns and modify existing patterns. Footprint blocks on 
a timeline are used to specify the time duration that each foot is in contact with 
a footprint. The user may specify keyframes in the animation sequence that 
allow more complicated body movements to be incorporated with the footprint 
based animation. This prior art introduces the concept of producing realistic 
images, however, does not explain nor imply the present invention, i.e., the 
method of producing and displaying wrinkles on limbs of a human being. 

[0010] U.S. Pat. No. 6,088,034 introduces a method and apparatus 
wherein three-dimensional compressed geometry is decompressed with a unit 
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having an input FIFO receiving compressed data bits and outputting to an 
input block state machine and an input block, whose outputs are coupled to a 
barrel shifter unit. According to this prior art, input block output also is input to 
Huffman tables that output to the state machine. The state machine output 
also is coupled to a data path controller whose output is coupled to a tag 
decoder, and to a normal processor receiving output from the barrel shifter 
unit. The decompressor unit also includes a position/color processor that 
receives output from the barrel shifter unit. Outputs from the normal processor 
and position/color processor are multiplexed to a format converter. For 
instructions in the data stream that generate output to the format converter, 
the decompression unit generates a tag sent to the tag decoder in parallel 
with bits for normals that are sent to the format converter. The decompressed 
stream of triangle data may then be passed to a traditional rendering pipeline, 
where it can be processed in full floating point accuracy, and thereafter 
displayed or otherwise used. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0011] U.S. Pat. No. 6,064,390 introduces an apparatus and method for 
representing expression in a tissue-like system that may include a human face, 
where the system is particularized to a specified individual. According to this 
prior art, a graphical representation generator implemented in a computer 
determines a representation, in terms of a finite-element model, of the surface 
of the tissue of the system, providing a graphic output defining the surface in 
world coordinates. An expressive detail generator, including a wrinkle 
generator, modifies the surface determined by the graphical representation 
generator before the surface has been mapped into world coordinates in 
accordance with three-dimensional features of the tissue-like system of a 
particular subject. This prior art introduces the concept of producing realistic 
images, however, does not explain nor imply the present invention, i.e., the 
method of producing and displaying wrinkles on limbs of a human being. 
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[0012] U.S. Pat. No. 5,850,222 introduces a computer system for 
displaying clothing on a rendered image of a human body referred to as a 
virtual dressing room system ("VDRS"). According to this prior art, the VDRS 
receives a series of contour lines defining the three-dimensional shape of the 
human body. A contour line is a series of points that defines the perimeter of 
the body in a horizontal plane. The VDRS also receives a sequence of points 
defining the two-dimensional shape of the clothing. The VDRS also scales the 
sequence of points defining the two-dimensional shape of the clothing to the 
approximate width of a portion of the human body over which the clothing is 
worn. For each point of the two-dimensional shape, the VDRS identifies a 
corresponding point on a contour line, and adjusts the point of the two- 
dimensional shape of the clothing to correspond to the identified point. The 
VDRS renders the shape of the human body on a display device, and lenders 
the scaled and adjusted two-dimensional shape of the clothing on the display 
device to effect the display of the human body wearing the clothing. This prior 
art introduces the concept of producing realistic images, however, does not 
explain nor imply the present invention, i.e., the method of producing and 
displaying wrinkles on limbs of a human being. 

[0013] U.S. Pat. No. 5,802,220 introduces a system which tracks human 
head and facial features over time by analyzing a sequence of images. 
According to this prior art, the system provides descriptions of motion of both 
head and facial features between two image frames. These descriptions of 
motion are further analyzed by the system to recognize facial movement and 
expression. The system analyzes motion between two images using 
parameterized models of image motion. Initially, a first image in a sequence of 
images is segmented into a face region and a plurality of facial feature regions, 
A planar model is used to recover motion parameters that estimate motion 
between the segmented face region in the first image and a second image in 
the sequence of images. The second image is warped or shifted back towards 
the first image using the estimated motion parameters of the planar model, in 
order to model the facial features relative to the first image. An affine model 
and an affine model with curvature are used to recover motion parameters 
that estimate the image motion between the segmented facial feature regions 
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and the warped second image. The recovered motion parameters of the facial 
feature regions represent the relative motions of the facial features between 
the first image and the warped image. The face region in the second image is 
tracked using the recovered motion parameters of the face region. The facial 
feature regions in the second image are tracked using both the recovered 
motion parameters for the face region and the motion parameters for the facial 
feature regions. The parameters describing the motion of the face and facial 
features are filtered to derive mid-level predicates that define facial gestures 
occurring between the two images. These mid-level predicates are evaluated 
over time to determine facial expression and gestures occurring in the image 
sequence. This prior art introduces the concept of producing realistic images, 
however, does not explain nor imply the present invention, i.e., the method of 
producing and displaying wrinkles on limbs of a human being. 

[0014] U.S. Pat. No. 5,687,737 introduces an optimal electrophysiologic 
mapping system for map-directed arrhythmia surgery and cardiac research 
allows rapid and accurate interpretation of cardiac activation sequences. 
According to this prior art, the system can display activation or potential 
distribution data on an anatomically accurate 3-D model of the heart and 
allows fast, interactive control of viewing characteristics, including control of 
which cardiac surfaces are displayed, control of virtual lighting, rotational 
control of the displayed image, etc. The system employs two computer 
programs, GETPIC3 and MAP3, and runs on a Silicon Graphics workstation 
capable of rapid graphics calculations and displays. The system utilizes 3-D 
models of epicardial and endocardial surfaces created with the GETPIC3 
program from a sequence of 2-D images of a heart. The individual surfaces 
are triangulated and may be smoothed using a spline function. The MAP3 
program displays activation times either as static isochronous maps or as 
dynamic time-since-last-activation maps. In the latter case, surface color 
denotes the time elapsed since a particular area activated. Potential 
distribution data may also be displayed dynamically. A mouse allows the 
system operator to control real-time rotation of the model in three dimensions, 
and any surface can be hidden interactively for better viewing of the data. 
Control is also provided over the starting, stopping, reversing, and repeating 
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of data, as well as over the frame rate for dynamic displays. This prior art 
introduces the concept of producing realistic images, however, does not 
explain nor imply the present invention, i.e., the method of producing and 
displaying wrinkles on limbs of a human being. 

[0015] U.S. Pat. No. 5,504,845 introduces a three dimensional image of a 
solid form which is presented to an operator by means of a stereoscopic 
display. According to this prior art, the operator defines a panel on the surface 
of the form with a set of bounding seam lines. A polygonal mesh is generated 
between the seam lines and is manipulated in three dimensions by the 
operator to achieve a desired surface appearance, including wrinkles, folds, 
pleats and other details. Manipulation of the mesh is constrained by the 
mechanical properties of the surface material or fabric being modelled. 
Surface texture and shading are then mapped onto the mesh to fully render 
the surface appearance in three dimensions. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0016] U.S. Pat. No. 5,267,154 introduces a biological image formation 
aiding system and a biological image forming method which are provided in 
which three-dimensional data corresponding to a standard shape of a 
biological article, standard motion thereof, and a standard material feeling of 
an outer surface of the biological article are prepared, and a realistic three- 
dimensional synthesized image of an entire biological article with individuality 
can be formed simply. According to this prior art, the system includes a shape 
data storage for storing data corresponding to a three-dimensional shape of a 
biological image; a motion data storage for storing data corresponding to 
three-dimensional motion of the biological image, a material feeling data 
storage for storing data corresponding to a three-dimensional material feeling 
of an outer surface of the biological image; editing/processing units capable of 
modifying at least one of the data corresponding to the three-dimensional 
shape of the biological image, the three-dimensional data corresponding to 
the motion of the biological image, and the data corresponding to the three- 
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dimensional material feeling of the outer surface of the biological image in 
accordance with a producer's intent; and an output unit responsive to the 
outputs of the editing/processing unit for synthesizing the data corresponding 
to the three-dimensional biological image, the data corresponding to the three- 
dimensional motion of the biological image, and the data corresponding to the 
three-dimensional material feeling of the outer surface of the biological image 
after modification with each other to provide synthesized three-dimensional 
data for a biological image to be produced. This prior art introduces the 
concept of producing realistic images, however, does not explain nor imply the 
present invention, i.e., the method of producing and displaying wrinkles on 
limbs of a human being. 

[0017] U.S. Pat. No. 6,326,967 introduces an image creating apparatus 
which displays a plurality of identical game-element images in predetermined 
colors on an image display unit by pasting textures on polygons provided in a 
virtual three-dimensional space. According to this prior art, the image creating 
apparatus includes a polygon-data storage unit for storing the coordinates of 
N (integer not less than 2) sets of polygons constituting the element images 
so that N game elements are arranged and displayed on the display unit; a 
texture-selection-data storage unit for selecting one set of the textures which 
corresponds to one of the characters; a color-data storage unit for storing, as 
a basic color, a first color determined for the one set of the textures; a color- 
data setting unit for setting a second color; and a composite-color setting unit 
for setting composite colors for the textures to be pasted on N sets of 
polygons, the composite colors being obtained by mixing the first color and 
the second color at different ratios. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0018] U.S. Pat. No. 6,322,448 introduces a image processing device for 
games which is a device whereby a prescribed number of models (characters) 
are set up in virtual space, these models are controlled such that they move in 
prescribed directions in the virtual space, and images of this virtual space 
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from a virtual viewpoint are displayed on means for display. According to this 
prior art, in order to display the movement of the models that are arranged in 
virtual space more realistically, in one construction thereof, this device is 
provided with means for image processing that apply virtual centripetal force 
to the models. Furthermore, in order to display the movement of the models 
more realistically and to heighten the dramatic effect, in one construction 
thereof, this device is equipped with means for processing residual image 
presentation in order to represent the track of movement of a model as 
residual images. This means for processing is equipped with means for 
storage that store without modification motion data of the model prior to the 
current motion and with means for display control that display this stored data 
together with the current motion data. This prior art introduces the concept of 
producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

[0019] U.S. Pat. No. 6,320,988 introduces a method of transforming the 
shape of a skeleton model, wherein this method can easily handle a skeleton 
model of a multiple-branching structure and enables the easy setting of 
complicated restrictive conditions. According to this prior art, node coordinates 
and arc-normal vectors are used as basic variables. Basic equations, which 
comprise an equation defining the length of an arc and which use basic 
variables as unknowns, and an evaluation expression for uniquely specifying 
a solution that satisfies these basic equations are modified, based on data 
such as mouse input. A solution for the basic variables that satisfies the basic 
equations and minimizes the value of the evaluation expression is obtained, 
and the shape of the skeleton model is transformed accordingly. The 
evaluation expression is used to set minimization of the sum-of-squares of 
arc-to-arc angles, rubber-banding, dampers, and inertia. The basic equations 
and the evaluation expression are updated in synchronization with the end of 
a loop. A spring restriction can be set, and the use of a restrictive condition in 
the next loop of the calculations can be determined from whether or not the 
restrictive condition was used in the previous loop, and whether or not an 
object has passed a boundary. This prior art introduces the concept of 
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producing realistic images, however, does not explain nor imply the present 
invention, i.e., the method of producing and displaying wrinkles on limbs of a 
human being. 

Summary of Invention 

[0020] It is an object of the present invention to provide a method of 
producing and displaying wrinkles on limbs of a human being. 

[0021] Still another object is to overcome the aforementioned 
shortcomings associated with the prior art. 

[0022] Further objects, features, and advantages of the present invention 
over the prior art will become apparent from the detailed description which 
follows, when considered with the attached figures. 

[0023] The present invention introduces a wrinkle simulation software 

for displaying a human being comprised of a plurality of arm joints, wherein 
each of the plurality of arm joints comprises a 1st part and a 2nd part. The 
invention also displays one or more wrinkles on or near the joint of the 1 st part 
and the 2nd part, wherein the 1st part and the 2nd part are connected, and 
the angle produced by the 1st part and 2nd part is variable. The more the 
value of the angle decreases, the more the amount and/or the height of the 
wrinkle increases, thereby enabling the wrinkle simulation software to display 
the movement of the human being and the movement of the 1st and the 2nd 
part in a realistic manner. 

[0024] The present invention further introduces a muscle movement 

simulation software for displaying a human being comprised of a plurality of 
arm joints, wherein each of the plurality of arm joints comprises a 1 st part and 
a 2nd part. The 1st part and the 2nd part are connected, and the angle 
produced by the 1st part and 2nd part is variable. The more the value of the 
angle decreases, the more the thickness of the 1st part increases, thereby 
enabling the muscle movement simulation software to display the movement 
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of the human being and the movement of the 1 st and the 2nd part in a realistic 
manner. 

Brief Description of Drawings 

[0025] The above and other aspects, features, and advantages of the 
invention will be better understood by reading the following more particular 
description of the invention, presented in conjunction with the following 
drawings, wherein: 

[0026] Figs. 1a and 1b are simplified illustrations illustrating the methods 
to display the arm of a human being by utilizing the prior art. 

[0027] 

[0028] Fig. 2 is a block diagram illustration of the computer which 
performs the present invention. 

[0029] Fig. 3 is a simplified illustration of the area included in the RAM. 

[0030] Fig. 4 is a simplified illustration illustrating the concept of the 
present invention. 

[0031] Fig. 5 is a simplified illustration illustrating one method of 
generating wrinkles. 

[0032] Fig. 6 is a simplified illustration illustrating another method of 
generating wrinkles. 

[0033] Fig. 7 is a simplified illustration of the area included in the RAM. 

[0034] Fig. 8 is a simplified illustration of the content included in the RAM 
illustrated in Fig. 7. 
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[0035] Figs. 9a through 9e are simplified illustrations of the methods to 
display the arm on the monitor. 

[0036] 

[0037] 

[0038] 

[0039] Fig. 10 is a simplified illustration of the area included in the RAM. 

[0040] Fig. 1 1 is a flowchart illustrating the operation of the wrinkle 
generating software. 

[0041] Figs. 12a through 12d are simplified illustrations of exemplary 
embodiments to produce wrinkles. 

[0042] 

[0043] 

[0044] 

[0045] Fig. 13 is a simplified illustration of the area included in the RAM. 

[0046] Fig. 14 is a simplified illustration of the content included in the 
RAM illustrated in Fig. 13. 

[0047] Figs. 15a through 15e are simplified illustrations of the methods to 
display a wrinkle on the monitor. 

[0048] 

[0049] 
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[0050] 
[0051] 

[0052] Fig. 16 is a simplified illustration of the area included in the RAM. 

[0053] Fig. 17 is a flowchart illustrating the operation of the wrinkle 
generating software. 

[0054] Figs. 18a through 18e are simplified illustrations of the methods to 
display the arm on the monitor. 

[0055] 

[0056] 

[0057] 

[0058] 

[0059] Fig. 19 is a simplified illustration of the area included in the RAM. 

[0060] Fig. 20 is a simplified illustration of the content included in the 
RAM illustrated in Fig. 20. 

[0061] Figs. 21a through 21 e are simplified illustrations of the methods to 
display the arm on the monitor. 

[0062] 

[0063] 

[0064] 
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[0065] 

[0066] Fig. 22 is a simplified illustration of the area included in the RAM. 

[0067] Fig. 23 is a flowchart illustrating the operation of the wrinkle 
generating software. 

[0068] Figs. 24a through 24e are simplified illustrations of the methods to 
display the arm on the monitor. 

[0069] 

[0070] 

[0071] 

[0072] 

[0073] Fig. 25 is a simplified illustration of the area included in the RAM. 

[0074] Fig. 26 is a simplified illustration of the method to display the arm 
on the monitor. 

[0075] Fig. 27 is a simplified illustration of the method to display muscle 
movement. 

[0076] Fig. 28 is a simplified illustration of the area included in the RAM. 

[0077] Fig. 29 is a simplified illustration of the data stored in the RAM. 

[0078] Figs. 30a through 30e are simplified illustrations of the methods to 
display the arm on the monitor. 
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[0079] 



[0080] 
[0081] 
[0082] 

[0083] Fig. 31 is a flowchart illustration of illustrating the operation of the 
muscle movement generating software. 

[0084] Figs. 32a through 32e are simplified illustrations of the methods to 
display the muscle movement on the monitor. 

[0085] 

[0086] 

[0087] 

[0088] 

Detailed Description 

[0089] The following description is of the best presently contemplated 
mode of carrying out the present invention. This description is not to be taken 
in a limiting sense but is made merely for the purpose of describing the 
general principles of the invention. The scope of the invention should be 
determined by referencing the appended claims. 

[0090] FIG. 2 illustrates the details of computer 200 which performs the 
present invention. CPU 21 1 controls and administers the overall function and 
operation of computer 200. CPU 21 1 uses RAM 206 to temporarily store data 
and/or to perform calculation to perform its function. Video generator 202 
generates analogue and/or digital video signals which are displayed on 
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monitor 201 . Sound generator 205 generates analogue and/or digital audio 
signals which are transferred to speaker 204. HDD 207 stores data and/or 
programs which are necessary to perform the present invention. Interface 208 
is an interface between computer 200 and a server which enables computer 
200 to send and receive digital data with the server. Input signals are input by 
input device 210, such as keyboard and joystick, and the signals are 
transferred via input interface 209 and data bus 203 to CPU 21 1 . Computer 
200 can have the same or similar structure to the computers which are 
described in FIG. 1 of U.S. Pat. No. 5,870.101, FIG. 2 of U.S. Pat. No. 
6,157,384, FIG. 1 of U.S. Pat. No. 5,774,125, FIG. 1 of U.S. Pat. No. 
5,375,206, and/or FIG. 1 of U.S. Pat. No. 5,925,127. Overall, computer 200 
has the capability of displaying three-dimensional objects on monitor 201 by 
utilizing the texture mapping method or polygon method. Video Generator 202 
is used for displaying the three-dimensional objects. 

[0091] As illustrated in Fig. 3, RAM 206 (Fig. 2) includes area 301 . Area 
301 stores a wrinkle generating software which is designated to generate 
wrinkles as described in details hereinafter. 

[0092] Fig. 4 illustrates the concept of the present invention. As described 
in Fig. 4, arm AR of an object (a human being) consists of hand HD, lower 
arm LA, joint JT, and upper arm UA. Assuming that arm UA is covered by 
fabric FB, i.e., the object is wearing a suit of clothes which covers his/her arms. 
When arm AR is bent, wrinkles 400 is generated on or near joint JT by the 
wrinkle generating software stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). 

[0093] Fig. 5 illustrates the method of generating wrinkles. The most 
convenient way to generate wrinkles is to paste a texture describing wrinkles 
on a piece of polygon by the method so-called the "texture mapping." The 
details of such method are explained in the patents described hereinbefore. 
The method of "texture mapping" is not explained in this patent specification in 
details since such method itself is not the object of the present invention. As 
illustrated in Fig. 5, texture 501 which is applied on or near joint JT (Fig. 4) 
has a pattern consisting of a plurality of plateaus and valleys. Plateaus 502, 
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519, and 505 represent the highest portion of the wrinkles displayed and 
valley 503 and 504 represent the space between the wrinkles. For purposes 
of designing texture 501, plateaus 502, 519, and 505 are displayed with lighter 
colors, and valley 503 and 504 are displayed with darker colors compared to 
these plateaus. 

[0094] Fig. 6 illustrates another method of generating wrinkles. A plurality 
of polygons in this embodiment are used to generate wrinkles. Namely, 
polygons P1 and P2, P3 and P4, and P5 and P6 represent a wrinkle 
respectively. More precisely, the connected portion of polygons P1 and P2 
represents plateau 502, the connected portion of polygons P2 and P3 
represents valley 503, the connected portion of polygons P3 and P4 
represents plateau 519, the connected portion of polygons P4 and P5 
represents valley 504, and the connected portion of polygons P5 and P6 
represents plateau 505 in Fig. 5. 

[0095] Fig. 7 through Fig. 12d illustrate the method of determining the 
amount of wrinkles that should be displayed on monitor 201 (Fig. 2). 

[0096] As illustrated in Fig. 7, RAM 206 (Fig. 2) includes area 302. Area 
302 stores a plurality of data which are necessary to produce a plurality of 
wrinkles. 

[0097] Fig. 8 illustrates the content of area 302 (Fig. 7) of RAM 206 (Fig. 
2). Area 302 includes two types of data, i.e., the data representing the angle 
of joint JT (Fig. 4) produced by upper arm UA (Fig. 4) and lower arm LA (Fig. 
4), and the data representing the amount of wrinkles displayed. In the 
example described in Fig. 8, the amount of wrinkles displayed is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
However, the amount of wrinkles increases as the angle of joint JT produced 
by upper arm UA and lower arm LA decreases. In the present example, the 
amount of wrinkle displayed is 1 when the angle is at least 160 degrees or 
more, but less than 180 degrees; the amount of wrinkles displayed is 2 when 
the angle is at least 135 degrees or more, but less than 160 degrees; the 
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amount of wrinkles displayed is 3 when the angle is at least 1 1 0 degrees or 
more, but less than 135 degrees; and the amount of wrinkles displayed is 4 
when the angle is at least 20 degrees or more, but less than 110 degrees. 

[0098] Fig. 9a through Fig. 9e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 302 (Fig. 7) of 
RAM 206 (Fig. 2). Assuming that arm AR is covered with fabric FB. When arm 
AR is stretched as described in Fig. 9a and the angle of joint JT (Fig. 4) 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As described in Fig. 9b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
at least 160 degrees or more, but less than 180 degrees, one wrinkle, i.e., 
wrinkle 401 is displayed on or near joint JT. As described in Fig. 9c, when arm 
AR is further bent and the angle of joint JT produced by lower arm LA and 
upper arm UA is at least 135 degrees or more, but less than 160 degrees, two 
wrinkles, i.e., wrinkles 401 and 402 are displayed on or near joint JT. As 
described in Fig. 9d, when the angle of joint JT produced by lower arm LA and 
upper arm UA is at least 110 degrees or more, but less than 135 degrees, 
three wrinkles, i.e., wrinkles 401 , 402, and 403 are displayed on or near joint 
JT. As described in Fig. 9e, when the angle of joint JT produced by lower arm 
LA and upper arm UA is at least 20 degrees or more, but less than 110 
degrees, four wrinkles, i.e., wrinkles 401 , 402, 403, and 404 are displayed on 
or near joint JT. 

[0099] Fig. 10 illustrates a plurality of texture utilized to display wrinkles 
on monitor 201 (Fig. 2). As illustrated in Fig. 10, RAM 206 (Fig. 2) includes 
area 303. Area 303 stores a plurality of textures which are pasted on polygons, 
i.e., textures Tx 506, Tx 507, Tx 508, and Tx 509. Tx 506 includes one wrinkle, 
i.e., wrinkle 401 illustrated in Fig. 9b; Tx 507 includes two wrinkles, i.e., 
wrinkles 401 and 402 illustrated in Fig. 9c; Tx 508 includes three wrinkles, i.e., 
wrinkles 401 , 402, and 403 illustrated in Fig. 9d; and Tx 509 includes four 
wrinkles, i.e., wrinkles 401, 402, 403, and 404 illustrated in Fig. 9e. 
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[0100] Fig. 1 1 illustrates the operation of the wrinkle generating software 
stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 degrees (S1a), CPU 211 does not access area 303 (Fig. 
10) of RAM 206 (S2a). If the angle is at least 160 degrees or more, but less 
than 1 80 degrees (S1 b), CPU 21 1 retrieves Tx 506 from area 303 of RAM 206 
(S2b). In the same manner, if the angle is at least 135 degrees or more, but 
less than 160 degrees (S1c), CPU 21 1 retrieves Tx 507 from area 303 of 
RAM 206 (S2c); if the angle is at least 1 1 0 degrees or more, but less than 1 35 
degrees (S1d), CPU 21 1 retrieves Tx 508 from area 303 of RAM 206 (S2d); 
and if the angle is at least 20 degrees or more, but less than 110 degrees 
(S1e), CPU 21 1 retrieves Tx 509 from area 303 of RAM 206 (S2e). 

[0101] Instead of pasting textures to polygons in order to display wrinkles, 
a plurality of polygons may be used to produce wrinkles as described in Fig. 
12a through Fig. 12d. One wrinkle can be produced by one set of two 
polygons, i.e., P7 and P8 as described in Fig. 12a. Two wrinkles can be 
produced by two sets of two polygons, i.e., P7 and P8, and P9 and P10 as 
described in Fig. 12b. Three wrinkles can be produced by three sets of two 
polygons, i.e., P7 and P8, P9 and P10, and P11 and P1 2 as described in Fig. 
12c. Four wrinkles can be produced by four sets of two polygons, i.e., P7 and 
P8, P9 and P10, P11 and P12, and P13 and P14 as described in Fig. 12d. 
The operation of the wrinkle generating software stored in area 301 (Fig. 3) of 
RAM 206 (Fig. 2) in this embodiment is similar to the one described in Fig. 1 1 . 
Such operation is not shown in the drawings. First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 1 80 degrees, CPU 211 does not produce any wrinkles by 
polygons. If the angle is at least 160 degrees or more, but less than 180 
degrees, CPU 21 1 produces polygons P7 and P8 to display one wrinkle as 
illustrated in Fig. 12a. In the same manner, if the angle is at least 135 degrees 
or more, but less than 160 degrees, CPU 21 1 produces polygons P7, P8, P9, 
and P10 to display two wrinkles as illustrated in Fig. 12b; if the angle is at 
least 110 degrees or more, but less than 135 degrees, CPU 21 1 produces 
polygons P7, P8, P9, P1 0, P1 1 , and P1 2 to display three wrinkles as 
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illustrated in Fig. 12c; and if the angle is at least 20 degrees or more, but less 
than 1 1 0 degrees, CPU 21 1 produces polygons P7, P8, P9, P1 0, P1 1 , P1 2, 
P13, and P14 to display four wrinkles as illustrated in Fig. 12d. 

[0102] Fig. 13 through Fig. 18d illustrate the method of determining the 
height of the wrinkles that should be displayed on monitor 201 (Fig. 2). 

[0103] As illustrated in Fig. 13, RAM 206 (Fig. 2) includes area 304. Area 
304 stores a plurality of data which are necessary to determine the height of 
the wrinkles. 

[0104] Fig. 14 illustrates the content of area 304 (Fig. 13) of RAM 206 
(Fig. 2). As illustrated in Fig. 14, area 304 includes two types of data, i.e., the 
data representing the angle of joint JT (Fig. 4) produced by upper arm UA (Fig. 
4) and lower arm LA (Fig. 4), and the data representing the height of wrinkles 
displayed. For example, the height of the wrinkle displayed is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
However, the height of the wrinkle increases as the angle of joint JT produced 
by upper arm UA and lower arm LA decreases. In the example explained in 
Fig. 14, the height of the wrinkle displayed is 1 when the angle is at least 160 
degrees or more, but less than 180 degrees; the height of the wrinkle 
displayed is 2 when the angle is at least 135 degrees or more, but less than 
1 60 degrees; the height of the wrinkle displayed is 3 when the angle is at least 
110 degrees or more, but less than 1 35 degrees; and the height of the wrinkle 
displayed is 4 when the angle is at least 20 degrees or more, but less than 
110 degrees. 

[01 05] Fig. 1 5a through Fig. 1 5e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 304 (Fig. 14) of 
RAM 206 (Fig. 13). Assuming that arm AR is covered with fabric FB. When 
arm AR is stretched as described in Fig. 15a and the angle of joint JT 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As illustrated in Fig. 15b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
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at least 160 degrees or more, but less than 180 degrees, a small wrinkle, i.e., 
wrinkle 410 is displayed on monitor 201 . As illustrated in Fig. 15c, when arm 
AR is further bent and the angle of joint JT produced by lower arm LA and 
upper arm UA is at least 135 degrees or more, but less than 160 degrees, a 
wrinkle larger than the one described in Fig. 1 5b is displayed on monitor 201 . 
As illustrated in Fig. 15d, when the angle of joint JT produced by lower arm LA 
and upper arm UA is at least 1 1 0 degrees or more, but less than 1 35 degrees, 
a wrinkle larger than the one described in Fig. 1 5c is displayed on monitor 201 . 
As illustrated in Fig. 15e, when the angle of joint JT produced by lower arm LA 
and upper arm UA is at least 20 degrees or more, but less than 110 degrees, 
a wrinkle larger than the one described in Fig. 1 5d is displayed on monitor 201 . 

[0106] Fig. 16 illustrates a plurality of textures utilized to display wrinkles 
on monitor 201 (Fig. 2). As illustrated in Fig. 16, RAM 206 (Fig. 2) includes 
area 305. Area 305 stores a plurality of textures which are pasted on polygons, 
i.e., textures Tx 510, Tx 51 1 , Tx 512, and Tx 513. Tx 510 includes the image 
of wrinkle 410 illustrated in Fig. 15b; Tx 51 1 includes the image of a larger 
wrinkle 410 illustrated in Fig. 15c; Tx 512 includes the image of wrinkle 410 
illustrated in Fig. 15d; and Tx513 includes the image of wrinkle 410 illustrated 
in Fig. 15e. 

[0107] Fig. 17 illustrates the operation of wrinkle generating software 
stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 degrees (S1a), CPU 21 1 does not access area 305 (Fig. 
16) of RAM 206 (Fig. 2) (S2a). If the angle is at least 160 degrees or more, 
but less than 1 80 degrees (S1 b), CPU 21 1 retrieves Tx 51 0 from area 305 
(Fig. 16) of RAM 206 (S2b). In the same manner, if the angle is at least 135 
degrees or more, but less than 160 degrees (S1c), CPU 21 1 retrieves Tx 51 1 
from area 305 of RAM 206 (S2c); if the angle is at least 110 degrees or more, 
but less than 135 degrees (S1d), CPU 21 1 retrieves Tx 512 from area 305 of 
RAM 206 (S2d); and if the angle is at least 20 degrees or more, but less than 
1 10 degrees, (S1e), CPU 21 1 retrieves Tx 513 from area 305 of RAM 206 
(S2e). 
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[01 08] Instead of pasting textures to polygons in order to display wrinkles, 
a plurality of polygons may be used to produce wrinkles as described in Fig. 
18a through Fig. 18e. Assuming that arm AR is covered with fabric FB. When 
arm AR is stretched as described in Fig. 18a and the angle of joint JT 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As illustrated in Fig. 18b, a small wrinkle 410 can 
be produced by two small polygons, i.e., P16 and P17. As illustrated in Fig. 
18c, a wrinkle 410 larger than the one described in Fig. 18b can be produced 
by the same set of polygons, i.e., P16 and P17 by stretching them vertically. 
As illustrated in Fig. 18d, a wrinkle 410 larger than the one described in Fig. 
18c can be produced by the same set of polygons, i.e., P16 and P17 by 
further stretching them vertically. As illustrated in Fig. 18e, a wrinkle 410 
larger than the one described in Fig. 18d can be produced by the same set of 
polygons, i.e., P16 and P17 by even more stretching them vertically. The 
operation of the wrinkle generating software in this embodiment is similar to 
the one described in Fig. 1 1 . Such operation is not shown in the drawings. 
First of all, CPU 21 1 (Fig. 2) calculates the angle of joint JT produced by lower 
arm LA and upper arm UA. If the angle is 1 80 degrees, CPU 21 1 does not 
produce any wrinkles with polygons. If the angle is at least 160 degrees or 
more, but less than 180 degrees, CPU 21 1 produces a small set of polygons 
P16 and P17 to display one wrinkle, wrinkle 410, as illustrated in Fig. 18b. In 
the same manner, if the angle is at least 135 degrees or more, but less than 
160 degrees, CPU 211 stretches polygons P16 and P17 vertically and makes 
wrinkle 410 as illustrated in Fig. 1 8c; if the angle is at least 1 1 0 degrees or 
more, but less than 135 degrees, CPU 21 1 further stretches polygons P16 
and P17 vertically and make wrinkle 410 as illustrated in Fig. 18d; and if the 
angle is at least 20 degrees or more, but less than 1 1 0 degrees, CPU 21 1 
even more stretches polygons P16 and P17 vertically and make wrinkle 410 
as illustrated in Fig. 18e. 

[0109] Fig. 19 through Fig. 24e illustrate the method of determining the 
amount and the height of wrinkles that should be displayed on monitor 201 
(Fig. 2). 
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[0110] As illustrated in Fig. 19, RAM 206 (Fig. 2) includes area 306. Area 
306 stores a plurality of data which are necessary to determine the amount 
and the height of the wrinkles. 

[011 1] Fig. 20 illustrates the content of area 306 (Fig. 19) of RAM 206 
(Fig. 2). As illustrated in Fig. 20, area 306 includes three types of data, i.e., 
the data representing the angle of joint JT (Fig. 4) produced by upper arm UA 
(Fig. 4) and lower arm LA (Fig. 4), the data representing the amount of 
wrinkles displayed, and the data representing the height of wrinkles displayed. 
For example, the amount and the height of wrinkle displayed is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
However, the amount of the wrinkle displayed is 1 and the height of the 
wrinkle displayed is 1 when the angle is at least 160 degrees or more, but less 
than 1 80 degrees; the amount of the wrinkle displayed is 1 and the height of 
wrinkle displayed is 2 when the angle is at least 135 degrees or more, but less 
than 1 60 degrees; the amount of the wrinkles displayed is 3 and the height of 
the wrinkles displayed is 1 , 2, and 1 respectively when the angle is at least 
1 1 0 degrees or more, but less than 1 35 degrees; and the amount of the 
wrinkles displayed is 5 and the height of the wrinkles displayed is 1 , 2, 3, 2, 
and 1 respectively when the angle is at least 20 degrees or more, but less 
than 110 degrees. 

[01 1 2] Fig. 21 a through Fig. 21 e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 306 (Fig. 19) of 
RAM 206 (Fig. 2). Assuming that arm AR is covered with fabric FB. When arm 
AR is stretched as described in Fig. 21a and the angle of joint JT produced by 
lower arm LA and upper arm UA is 180 degrees, no wrinkles are shown on or 
near joint JT. As illustrated in Fig. 21b, when arm AR is slightly bent and the 
angle of joint JT produced by lower arm LA and upper arm UA is at least 160 
degrees or more, but less than 1 80 degrees, a small wrinkle, i.e., wrinkle 41 1 
is displayed on monitor 201 . As illustrated in Fig. 21c, when arm AR is further 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
at least 1 35 degrees or more, but less than 1 60 degrees, wrinkle 41 1 which is 
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larger than the one described in Fig. 21 b is displayed on monitor 201 . As 
illustrated in Fig. 21d, when the angle of joint JT produced by lower arm LA 
and upper arm UA is at least 1 1 0 degrees or more, but less than 1 35 degrees, 
wrinkle 411 as large as the one described in Fig. 21c is displayed on monitor 
201 and two small wrinkles, i.e., wrinkles 412 and 413 appear on the left and 
right sides of wrinkle 411 respectively. As illustrated in Fig. 21 e, when the 
angle of joint JT produced by lower arm LA and upper arm UA is at least 20 
degrees or more, but less than 110 degrees, wrinkle 41 1 larger than the one 
described in Fig. 21 d is displayed on monitor 201 and wrinkles 412 and 413 
as large as the one described in Fig. 21 c appear on both sides of wrinkle 41 1 
respectively, and in addition small wrinkles 414 and 420 appear adjacent to 
wrinkles 412 and 413 respectively. 

[01 1 3] Fig. 22 illustrates a plurality of textures utilized to display wrinkles 
on monitor 201 (Fig. 2). As illustrated in Fig. 22, RAM 206 (Fig. 2) includes 
area 307. Area 307 stores a plurality of textures which are pasted on polygons, 
i.e., textures Tx 515, Tx 516, Tx 517, and Tx 518. Tx 515 includes the image 
of wrinkle 41 1 illustrated in Fig. 21b; Tx 516 includes the image of wrinkle 41 1 
illustrated in Fig. 21c; Tx 51 7 includes the image of wrinkles 41 1,412, and 
413 illustrated in Fig. 21d; and Tx518 includes the image of wrinkles 41 1 , 412, 
413, 414, and 420 illustrated in Fig. 21e. 

[01 14] Fig. 23 illustrates the operation of wrinkle generating software 
stored in area 301 (Fig. 3) of RAM 206 (Fig. 2). First of all, CPU 21 1 (Fig. 2) 
calculates the angle of joint JT produced by lower arm LA and upper arm UA. 
If the angle is 180 degrees (S1a), CPU 211 does not access area 307 (Fig. 
22) of RAM 206 (S2a). If the angle is at least 160 degrees or more, but less 
than 1 80 degrees (S1 b), CPU 21 1 retrieves Tx 51 5 from area 307 of RAM 206 
(S2b). In the same manner, if the angle is at least 135 degrees or more, but 
less than 160 degrees (S1c), CPU 21 1 retrieves Tx 516 from area 307 of 
RAM 206 (S2c); if the angle is at least 1 1 0 degrees or more, but less than 1 35 
degrees (S1d), CPU 21 1 retrieves Tx 517 from area 307 of RAM 206 (S2d); 
and if the angle is at least 20 degrees or more, but less than 1 1 0 degrees 
(S1e), CPU 21 1 retrieves Tx 518 from area 307 of RAM 206 (S2e). 
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[01 1 5] Instead of pasting textures to polygons in order to display wrinkles, 
a plurality of polygons may be used to produce wrinkles as described in Fig. 
24a through Fig. 24e. Assuming that arm AR is covered with fabric FB. When 
arm AR is stretched as described in Fig. 24a and the angle of joint JT 
produced by lower arm LA and upper arm UA is 180 degrees, no wrinkles are 
shown on or near joint JT. As illustrated in Fig. 24b, when arm AR is slightly 
bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
at least 160 degrees or more, but less than 180 degrees, a small wrinkle, i.e., 
wrinkle 41 1 is displayed on monitor 201 by a set of two polygons P1 6 and P1 7. 
As illustrated in Fig. 24c, when arm AR is further bent and the angle of joint JT 
produced by lower arm LA and upper arm UA is at least 135 degrees or more, 
but less than 1 60 degrees, wrinkle 41 1 which is larger than the one described 
in Fig. 24b is displayed on monitor 201 by stretching the set of two polygons 
P16 and P17 vertically. As illustrated in Fig. 24d, when the angle of joint JT 
produced by lower arm LA and upper arm UA is at least 110 degrees or more, 
but less than 135 degrees, wrinkle 411 as large as the one described in Fig. 
24c is displayed on monitor 201 by the set of polygons P16 and P17 and two 
small wrinkles, i.e., wrinkles 412 and 413 appear on the left and right sides of 
wrinkle 41 1 respectively. Wrinkle 41 2 is produced by the set of polygons P1 8 
and P 19, and wrinkle 413 is produced by the set of polygons P20 and P21 . 
As illustrated in Fig. 21 e, when the angle of joint JT produced by lower arm LA 
and upper arm UA is at least 20 degrees or more, but less than 110 degrees, 
wrinkle 41 1 larger than the one described in Fig. 21 d is displayed on monitor 
201 by further stretching the set of polygons P16 and P17 vertically and 
wrinkles 412 and 413 as large as wrinkle 41 1 in Fig. 21 d appear on both sides 
of wrinkle 41 1 respectively. Here, wrinkles 412 and 413 are produced by the 
sets of P18 and P 19, and P20 and P21 respectively, and they are stretched 
to increase the height thereof. Additional wrinkles 414 and 420 appear 
adjacent to wrinkles 412 and 413 respectively where wrinkles 414 and 420 are 
produced by the sets of P22 and P23, and P24 and P25 respectively. The 
operation of the wrinkle generating software in this embodiment is similar to 
the one described in Fig. 1 1 . Such operation is not shown in the drawings. 
First of all, CPU 21 1 (Fig. 2) calculates the angle of joint JT produced by lower 



27 



arm LA and upper arm UA. If the angle is 1 80 degrees, CPU 21 1 does not 
produce any wrinkles with polygons. If the angle is at least 160 degrees or 
more, but less than 180 degrees, CPU 21 1 produces a small set of polygons 
P1 6 and P1 7 to display wrinkle 41 1 as illustrated in Fig. 24b. In the same 
manner, if the angle is at least 135 degrees or more, but less than 160 
degrees, CPU 211 stretches polygons P16 and P17 vertically and make 
wrinkle 41 1 as illustrated in Fig. 24c; if the angle is at least 110 degrees or 
more, but less than 135 degrees, CPU 211 stretches polygons P16 and P17 
vertically and make wrinkle 41 1 as illustrated in Fig. 24d and add two small 
wrinkles, i.e., wrinkle 412 and 413 by producing P18 and P19, and P20 and 
P21 respectively; and if the angle is at least 20 degrees or more, but less than 
110 degrees, CPU 21 1 further stretches polygons P16 and P17 vertically and 
make wrinkle 41 1 as illustrated in Fig. 24e. CPU 21 1 increases the height of 
wrinkles 412 and 413 by stretching the two sets of polygons P18 and P19, 
and P20 and P21 respectively. In addition, CPU 21 1 adds two small wrinkles 
414 and 420 adjacent to wrinkles 412 and 413 respectively by producing two 
sets of polygons P22 and P23, and P24 and P25 respectively. 

[0116] Fig. 25 through Fig. 32e illustrate the method of determining the 
muscle movement of upper arm UA. 

[0117] Fig. 25 illustrates the content of area 308 of RAM 206 (Fig. 2). 
Area 308 stores the muscle movement generating software which administers 
the muscle movement of upper arm UA as described in details hereinafter. 

[01 1 8] Fig. 26 illustrates the concept of the present invention. As 
described in Fig. 26, arm AR of an object (a human being) is composed of 
hand HD, lower arm LA, joint JT, and upper arm UA. When arm AR is bent, 
muscle M bulges and thereby increases the thickness of upper arm UA. 

[01 1 9] Fig. 27 illustrates the method of generating the muscle movement. 
The most convenient way to generate the muscle movement is to have the 
muscle M composed of a plurality of polygons. In the example described in 
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Fig. 27, muscle M is composed of polygons P42, P43, P44, and P45. 
Polygons P46 and P47 are part of upper arm UA, but not part of muscle M. 

[0120] As illustrated in Fig. 28, RAM 206 (Fig. 2) includes area 309. Area 
309 stores a plurality of data which are necessary to produce the muscle 
movement of upper arm UA. 

[0121] Fig. 29 illustrates the content of area 309 (Fig. 28) of RAM 206. 
Area 309 includes two types of data, i.e., the data representing the angle of 
joint JT (Fig. 26) produced by upper arm UA (Fig. 26) and lower arm LA (Fig. 
26), and the data representing the property of the muscle movement. The 
more the value of muscle property increases the more the thickness of upper 
arm UA increases. For example, the value of muscle property is 0 when the 
angle of joint JT produced by upper arm UA and lower arm LA is 180 degrees. 
The value of the muscle property increases as the angle of joint JT produced 
by upper arm UA and lower arm LA decreases. In the present example 
described in Fig. 29, the value of muscle property is 1 when the angle is at 
least 1 60 degrees or more, but less than 1 80 degrees; the value of muscle 
property is 2 when the angle is at least 135 degrees or more, but less than 
160 degrees; the value of muscle property is 3 when the angle is at least 110 
degrees or more, but less than 135 degrees; and the value of muscle property 
is 4 when the angle is at least 20 degrees or more, but less than 110 degrees. 

[0122] Fig. 30a through Fig. 30e illustrate how arm AR is displayed on 
monitor 201 (Fig. 2) in accordance with the data stored in area 309 (Fig. 28) of 
RAM 206 (Fig. 2). When arm AR is stretched as described in Fig. 30a and the 
angle of joint JT produced by lower arm LA and upper arm UA is 180 degrees, 
no muscle movement appears on upper arm UA. As described in Fig. 30b, 
when arm AR is slightly bent and the angle of joint JT produced by lower arm 
LA and upper arm UA is at least 160 degrees or more, but less than 180 
degrees, the muscle movement occurs and muscle M bulges. As described in 
Fig. 30c, when arm AR is further bent and the angle of joint JT produced by 
lower arm LA and upper arm UA is at least 135 degrees or more, but less than 
160 degrees, muscle M bulges more compared to the one shown in Fig. 30b. 
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As described in Fig. 30d, when the angle of joint JT produced by lower arm LA 
and upper arm UA is at least 1 1 0 degrees or more, but less than 1 35 degrees, 
muscle M bulges more compared to the one shown in Fig. 30c. As described 
in Fig. 30e, when the angle of joint JT produced by lower arm LA and upper 
arm UA is at least 20 degrees or more, but less than 110 degrees, muscle M 
bulges more compared to the one shown in Fig. 30d. 

[0123] Fig. 31 illustrates the operation of the muscle movement 
generating software stored in area 308 (Fig. 25) of RAM 206 (Fig. 2). First of 
all, CPU 21 1 (Fig. 2) calculates the angle of joint JT produced by lower arm 
LA and upper arm UA. If the angle is 1 80 degrees (S1 a), CPU 21 1 retrieves 
the muscle property data from area 309 (Fig. 29) of RAM 206 (Fig. 2). Since 
the muscle property is 0, no muscle movement occurs and upper arm UA 
described in Fig. 30a is shown (S2a). If the angle is at least 160 degrees or 
more, but less than 180 degrees (S1b), CPU 211 retrieves the muscle 
property which is 1 and upper arm UA described in Fig. 30b is shown (S2b). In 
the same manner, if the angle is at least 135 degrees or more, but less than 
160 degrees (S1c), CPU 21 1 retrieves the muscle property which is 2 and 
upper arm UA described in Fig. 30c is shown (S2c); if the angle is at least 110 
degrees or more, but less than 135 degrees (S1d), CPU 21 1 retrieves the 
muscle property which is 3 and upper arm UA described in Fig. 30d is shown 
(S2d); and if the angle is at least 20 degrees or more, but less than 1 1 0 
degrees (S1e), CPU 21 1 retrieves the muscle property which is 4 and upper 
arm UA described in Fig. 30e is shown (S2e). 

[0124] Fig. 32a through Fig. 32e illustrate how the polygons are utilized in 
displaying the muscle movement. 

[0125] As illustrated in Fig. 32a, when arm AR is stretched and the angle 
of joint JT produced by lower arm LA and upper arm UA is 180 degrees, no 
muscle movement appears on upper arm UA and the polygons consisting of 
muscle M, i.e., P27, P28, and P29 remains in a straight line or almost in a 
straight line. Polygons P26 and P30 are part of upper arm UA, however, does 
not compose muscle M. As described in Fig. 32b, when arm AR is slightly 
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bent and the angle of joint JT produced by lower arm LA and upper arm UA is 
at least 160 degrees or more, but less than 180 degrees, the muscle 
movement occurs and muscle M composed of polygons P27, P28, and P29 
bulges. As described in Fig. 32c, when arm AR is further bent and the angle of 
joint JT produced by lower arm LA and upper arm UA is at least 135 degrees 
or more, but less than 160 degrees, muscle M composed of polygons P27, 
P28, and P29 bulges more compared to the one shown in Fig. 32b. As 
described in Fig. 32d, when the angle of joint JT produced by lower arm LA 
and upper arm UA is at least 110 degrees or more, but less than 1 35 degrees, 
muscle M composed of polygons P27, P28, and P29 bulges more compared 
to the one shown in Fig. 32c. As described in Fig. 32e, when the angle of joint 
JT produced by lower arm LA and upper arm UA is at least 20 degrees or 
more, but less than 110 degrees, muscle M bulges more compared to the one 
shown in Fig. 32d. Here, muscle M is composed of polygons P27, P28, and 
P29, and new polygons P31 and P32 are inserted between P27 and P28, and 
P28 and P29, respectively. 

[0126] Having thus described a presently preferred embodiment of the 
present invention, it will not be appreciated that the aspects of the invention 
have been fully achieved, and it will be understood by those skilled in the art 
that many changes in construction and circuitry and widely differing 
embodiments and applications of the invention will suggest themselves 
without departing from the spirit and scope of the present invention. The 
disclosures and the description herein are intended to be illustrative and are 
not in any sense limiting of the invention, more preferably defined in scope by 
the following claims. 
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